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Background/context: 

Description of prior research and/or its intellectual context and/or its policy context. 

Reading is critical to children’s academic and future economic success. Yet reading skills 
continue to lag in the upper elementary grades. Recent NAEP results from 2004, for example, 
showed that 69% of fourth-graders scored below a proficient level in reading, and 36% of fourth- 
graders scored in the below basic category (NAEP, 2005). Focused instruction on the basic skills 
of phonemic awareness, phonics and decoding fluency are beginning to show results in the 
primary grades. But many schools and districts report stagnation or even declines once students 
enter fourth grade, where the focus of reading instruction should turn to comprehension in other 
content areas (Snow, 2002). 



One way that school districts across the country have responded to the challenge of improving 
students’ reading skills has been to hire additional, presumably more skilled, teachers as 
“instructional coaches” to work with teachers to improve their instructional practice (Neufeld & 
Roper, 2003; Richard, 2003; Russo, 2004). However, there is no agreed upon definition of the 
coaching job, and the actual tasks that coaches carry out vary widely. In some schools coaches 
work with individual and small groups of teachers to analyze and plan lessons, and they may do 
some actual in-class observation and provide some “at elbow” guidance for teachers. In many 
schools, however, coaches are an extra pair of hands whom principals ask to take on various 
administrative tasks (for example, overseeing testing, ordering supplies, setting up school 
programs, attending district meetings, etc.) or to provide additional instructional 
time/intervention to individual or small groups of students. Most coaches receive very little 
training and ongoing support in either the subject-matter content or pedagogical strategies they 
are meant to help teachers master. Moreover, in the absence of clear standards for coach 
qualifications, coaches may not be more expert in their content area than the teachers they are 
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intended to instruct (Allington, 2007; Frost & Bean, 2006; International Reading Association, 
2004). Not surprisingly, attempts to study the effectiveness of coaching have mostly found that 
coaching programs have been so poorly or variably implemented that it is not possible to 
determine with confidence what effect well-implemented coaching would have on either teacher 
performance or student learning (e.g., Rivera, Burley & Sass; 2004; Wade, 1985). While some 
evidence exists that coaching might improve teacher learning under specific conditions (e.g., 
Joyce & Showers, 1988), there is virtually no evidence that coaching improves student learning. 



Purpose/objective/research question/focus of study: 

Description of what the research focused on and why. 

Our project implements and studies a structured coaching program (Content-Focused 
Coaching SM ; CFC) that is designed to improve reading comprehension instruction in the upper 
elementary grades. The fundamental research question for our study is: 



1) What is the effect of a well-defined instructional coaching program (CFC) on reading 
comprehension instruction and students’ reading achievement? 

Setting: 

Specific description of where the research took place. 

The study was conducted in an urban school district in Texas serving large numbers of Hispanic, 
English language learning students from low-income families. The schools in our study (N= 29) 
were sampled from the 32 lowest achieving schools in the district. Prior to the beginning of the 
CFC intervention, one treatment and two comparison schools left the study, resulting in 29 
schools total (15 treatment and 14 comparison). 

Population/Participants/Subj ects : 

Description of participants in the study: who (or what) how many, key features (or characteristics). 

Teachers. Only 98 of the 177 teachers participating in the first year of the study (55%) remained 
at their school or grade for the second year of the study (CFC n = 60 61%; Comparison n = 38 
39%). Two teachers from comparison schools moved to treatment (CFC) schools. These teachers 
were treated as new teachers in the study and are not included in the results reported in this 
paper. One teacher who left a treatment school to teach at a comparison school and so was no 
longer eligible to be in the study. 

Of the 98 teachers who remained, 58% teach fourth grade and 42% teach fifth grade. Over a 
third of the teachers (38%) have a Master’s degree. A small number of teachers (4%) hold 
National Board for Professional Teaching Standards certification. Eight-percent of the teachers 
hold temporary, provisional, or emergency certification. Sixty-percent of the teachers teach a 
designated ELL class. As a group, teachers have a wide range of teaching experience, ranging 
from 0 to 32 years and averaging about 10 years teaching generally and 9 years teaching reading. 
English is the language of instruction for the majority of teachers (53%). The remaining teachers 
teach lessons in both English and Spanish. The teachers in the comparison and intervention 
schools do not differ on any demographic characteristics. Comparisons between the 98 two-year 
longitudinal teachers and teachers who left their grade or school at Year 2 indicated no 
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differences in education, teaching experience, or certification backgrounds. Only one difference 
(pc. 05) emerged in the language of instruction in the Year 1 classes: 73% of teachers who left 
their school or grade taught their classes in English only compared to 53% of the longitudinal 
teachers. 

Students. Nearly all of the students in the study schools (A=1714) are eligible for free or 
reduced-price lunch (91%). The large majority of students (80%) are Hispanic. The remaining 
students are African American (15%), white (3%) and Asian (2%). Forty-percent of the students 
are classified as Limited English Proficient (n=741 ), and 2% are immigrants from a non-English- 
speaking country. Differences in the student population between the treatment and comparison 
schools were included as covariates in the analyses. 



Intervention/Program/Practice : 

Specific description of the intervention, including what it was, how it was administered, and its duration. 

Content-Focused Coaching (CFC) is an intensive professional development program that aims to 
ameliorate the problems of implementing effective coaching in schools by, first, providing 
coaches with the knowledge and skills they need to work effectively with teachers and, second, 
helping create the organizational conditions in schools and districts that are posited to support 
effective coaching. The program was originally developed in mathematics (West & Staub, 2003), 
but was adapted by fellows from the University of Pittsburgh’s Institute for Learning to support 
literacy coaching in elementary schools (Staub & Bickel, 2003; Staub, West, & Bickel, 2003). 



For the purpose of the study, school district leaders and fellows from the University of 
Pittsburgh’s Institute for Learning (IFL) collaborated to hire the CFC coaches. CFC coaches 
engaged in three days of professional development per month over the course of two academic 
years. The professional development, led by the IFL fellows, is designed to increase coaches’ 
knowledge of the theory and research underlying effective reading comprehension, vocabulary, 
and writing instruction (Beck, McKeown, & Kucan, 2002; Block & Pressley, 2002; Hirsch, 
2003, 2006; New Standards, 1999; Resnick, 1995; Resnick & Hall, 2001; Sinatra, Brown, & 
Reynolds, 2002; Willingham, 2006), with a special emphasis on the role of classroom talk and 
vocabulary instruction in supporting students’ understanding of texts The program also focuses 
on building coaches’ pedagogical skills so that they can model exemplary reading 
comprehension lessons in teachers’ classrooms and coaches’ expertise at working effectively 
with teachers in schools. Coaches engage in “coaching labs,” in which they observe other 
coaches and IFL trainers working with teachers to plan a future lesson, reflect together on an 
enacted lesson, and/or determine next steps for improving student learning. 



CFC-trained coaches, in turn, are expected to meet with teachers individually and in weekly 
grade-level team meetings to study the theory underlying effective reading comprehension 
instruction and plan rigorous reading comprehension lessons (i.e. to implement what they learned 
in the training). CFC coaches also are expected to model lessons, co-teach, observe reading 
comprehension lessons in teachers’ classrooms on a regular basis, and reflect on the 
effectiveness of these lessons (e.g., what students seemed to understand, what they seemed to 
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have difficulty comprehending, etc.) with teachers in post-lesson conferences. Improved quality 
of reading comprehension instruction, in turn, is posited to lead to improved student achievement 
in reading. 



Research Design: 



This study is a randomized-field trial. 



Data Collection and Analysis: 

Description of plan for collecting and analyzing data, including description of data. 

Teachers completed surveys at baseline and at the end of each study year focused on 
their participation in literacy coaching and instructional practice. Teachers also were 
observed teaching a reading comprehension lesson twice during each study year (in 
fall and spring). Student achievement was assessed on the Degrees of Reading Power 
(DRP) assessment and the state achievement test (Texas Assessment of Knowledge 
and Skills, TAKS). Repeated measures analyses of variance were used to identify and 
compare patterns of change in teachers’ participation in coaching activities, the 
content emphasized in coaching activities, and teachers’ perceptions of the usefulness 
of coaching for improving their practice. Frequencies also were computed to describe 
variation in teachers’ participation in specific coaching activities. Repeated measures 
analyses of variance also were used to investigate patterns of change over time in 
teachers’ self-reported and observed instruction. HLM analyses were used to estimate 
the relative effect of CFC on student achievement. 



Findings/Results: 



Results indicate that teachers’ in the CFC schools significantly and positively increased in the 
frequency of their participation in coaching focused on enacting instruction and understanding 
the theory underlying effective reading comprehension instruction. Teachers in the CFC schools 
also showed modest improvement in the quality of their observed and self-reported reading 
comprehension instruction. No difference between groups was detected for students’ reading 
achievement on the whole (iV=1714 LEP and non-LEP students). Students designated as Limited 
English Proficient (n=741) in the CFC schools, however, had significantly higher scores on the 
TAKS. No difference between groups was detected on the DRP. 

Conclusions: 



The implications for education policy with regard to the use of coaching resources in urban 
districts, and challenges of conducting a multi-level intervention and a randomized-field trial in 
an urban district with high-levels of teacher (and student) mobility will be discussed. 
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